Skip to content

Conversation

@chungjac
Copy link
Contributor

Problem

  • invokeLLM metric needs more fields for latency

Solution

  • amazonq_invokeLLM metric has these fields:
    • latency
    • toolCallLatency
    • timeToFirstChunk
    • timeBetweenChunks

Note

  • I would've liked to use a more reusable/general name such as latency2 (like how we have requestId and requestId2) instead of toolCallLatency which seems very specific to only tools. However, I have already put in the implementation PR to make the deadline for the flare release, as flare release happens 1 day before toolkit release.
  • VSC is the only IDE which requires a version bump for aws-toolkit-common. All other IDEs (JB, Eclipse, VS) use flare as the source of truth for metrics.

License

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@chungjac chungjac requested a review from a team as a code owner June 17, 2025 15:40
@laileni-aws laileni-aws merged commit 45be739 into aws:main Jun 17, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants